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Abstract: We study the Hopfield model with pure p-spin interactions with even p > 4:, and 
a number of patterns, M{N) growing with the system size, N, as M{N) = aN^~^. We 
prove the existence of a critical temperature (3p characterized as the first time quenched and 
annealed free energy differ. We prove that as p ] oo, j3p —>■ \/a21n2. Moreover, we show 
that for any a > and for all inverse temperatures /3, the free energy converges to that 
of the REM at inverse temperature Moreover, above the critical temperature the 

distribution of the replica overlap is concentrated at zero. We show that for large enough 
a, there exists a non-empty interval of in the low temperature regime where the distribution 
has mass both near zero and near ±1. As was first shown by M. Talagrand in the case of the 
p-spin SK model, this implies the the Gibbs measure at low temperatures is concentrated, 
asymptotically for large N, on a countable union of disjoint sets, no finite subset of which 
has full mass. Finally, we show that there is Op ~ l/p\ such that for a > ap the set carrying 
almost all mass does not contain the original patterns. In this sense we describe a genuine 
spin glass transition. 

Our approach follows that of Talagrand's analysis of the p-spin SK-model. The more 
complex structure of the random interactions necessitates, however, considerable technical 
modifications. In particular, various results that follow easily in the Gaussian case from 
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integration by parts fromulas have to be derived by expansion techniques. 
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1. Introduction and Results 

In a recent paper [T4] (see also [T6] for a more pedagogical exposition) Talagrand has pre- 
sented for the first time a rigorous analysis of a phase transition from a high temperature 
phase to what could be called a "spin glass phase". This was done in the context of the so 
called p-spin Sherrington-Kirkpatrick (SK) model [SK] for p >3. Prom the heuristic analysis 
on the basis of the replica method (see [MPV]), it is known that this model should have a 
spin glass phase that is much simpler than in the case p = 2, the standard SK model, and 
this fact is to be expected to be related to the success of Talagrand's approach. In any event, 
this important new result has highlighted the p-spin interaction model as an important play- 
ground to develop new techniques and to gain more insight into the fascinating world of spin 
glasses. 

The Hamiltonian of the p-spin SK model can most simply be described as a Gaussian 
process on the hypercube Sn = {—1, 1}^ with mean zero and covariance function 

EX^X^> = NR^ia, a')P (1.1) 

where -Rjv(c, a') = jj^ YliLi — ^~dis^Ham{'^-i (^') where dnam denotes the Hamming distance. 
Seen from this point of view, the distinction between different values of p is in the speed of 
decrease of the correlation of the process X^ with distance. 

Talagrand's methods use heavily the Gaussian nature of the SK model, and in particular 
the fact the X„ can be represented in the form 

Xa= 5Z •^ii,...,ip<^n, • • -o-ip (1-2) 

l<ii<i2<---<ip<iV 

where Ji. j is a family of i.i.d. standard Gaussian random variables. It is therefore 
natural to ask whether and to what extent his approach can be generalized to other models 
that have similar correlation decay properties as processes on S^^ but that are not Gaussian 
and do not have the simple structure as (1.2). A natural candidate to test this question 
on and whose investigation has considerable interest in its own right, is the so-called p-spin 
Hopfield model which we shall describe below. These models have been introduced in the 
context of neural networks by Peretto and Nicz [PN] and Lee ct al. [Lee] as generalizations 
of the standard Hopfield model [Ho] which corresponds to the case p = 2. This latter case 
has been studied heavily and since its first introduction by Figotin and Pastur [FP1,FP2] 
has become, on the rigorous level, one of the best understood mean field spin glass models 
[Nl,ST,Ko,BGPl,BGP2,BGl,BG2,BG3,BG4,T3,T7]. It should be noted, however, that ah 
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the results obtained for this model so far concern the high-temperatures phase and the so- 
called retrieval phase, while next to nothing is known about the supposedly existing spin 
glass phase. The investigation of this phase in the p > 4 version of the model is the main 
concern of the present paper. 

We now give a precise definition of the models we will study. Let (O, jr,P) be an abstract 
probability space and {Cf }i,/:<eN a family of i.i.d. Bernoulli variables, taking values 1 and —1 
with equal probability. 

Define for each N eN a (finite) random Hamiltonian, that is, a function Hn '■ ^ x Sn — 1^ 

by 

^ ^ ([i=l ii<...<ipl=l 

The value of p is considered a fixed parameter of the model, and will in the following be 
even and at least be 4. While this model can be analyzed rather easily along the lines of the 
standard Hopfield model if M ~ AT (see [BGl]), the results of Newman [Nl] on the storage 
capacity suggest that the model should have a good behavior even if M{N) scales as Np~^, 
i.e.5 

M(N) , , 

lim — r^-r = a < oo. (1.4) 

In this paper we will always be concerned with this case. The limit a will also turn out to 
be a crucial parameter for the behavior of the system. In the standard Hopfield model, it 
has been proven that for small values of a, the model at low temperatures is in a retrieval 
phase, where there are Gibbs measures that are concentrated on small neighborhoods of the 
stored patterns. It is believed that for large values of a (or smaller values of /?) this property 
fails and that in fact the model should then be very similar to the Sherrington-Kirkpatrick 
model; however, there exist no rigorous results to that effect. While in the present paper 
we do not present results concerning the retrieval phase in the p > 4 case, the results we 
shall present show that for reasonably large values of a a phase transition occurs from the 
high-temperature phase to a "spin glass phase" that is strikingly similar to those of the 
corresponding SK models. 

Wc will use the following multi-index notation. For finite subsets X of the natural numbers, 
and real numbers (x„)„gN) let by xx = Hiei ^i- Let furthermore be the set of subsets of 
M = {1, . . . , N} of cardinality p. The Hamiltonian (1.3) can then be written as 



■"In the sequel, we will write with slight abuse of notation M{N) = aN^ ^ even for finite N. 
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These Hamiltonians define random, finite volume Gibbs measures Gn,i3[i^] by assigning each 
configuration a G Sn a weight proportional to its Boltzmann factor, that is 

-^N, 131^1 

Consider now the Hamiltonian as a random process indexed by o" G Sn- Simple calculations 
allow to verify that the mean of with respect to P vanishes for all a, that is Effjv(<T) = 
0, V(T G 5jv, whereas the variance satisfies (for some number C depending on p only) 

, M{N) 

aNil-CN-')<EH^{ar = j^ ^ ^ <aN, (1.7) 

At=l I€Vn 

which motivates our choice of normalization in the definition of -ffjv- The covariance is given 
as 

, M(JV) 

where -Rjv(f, cr') = X^^i CTjCr^ is the (normalized) replica overlap. Note that this covariance 
is in leading order and up to the factor a the same as the covariance for the p-spin SK-model 
([T4]). 

The normalizing factor Zn^^ in (1.6) is called partition function and it is given by 

Zjv,M^]=E.e-^^-[-l(«), (1.9) 

where E^. is the expectation with respect to the uniform distribution on Sn ■ We will call the 
mean of ^Ar,/3 under P the annealed partition function. 

We define the free energy Fjv,/3[a;] by Fjv,/3[a;] = lnZjv,/3[a;].^ Customarily one calls the 
mean of the free energy, EFjv,/3, the quenched free energy, while the normalized logarithm 
of the annealed partition function is called the annealed free energy = -^lnEZjv,/3. 

Observe that by Holder's inequality, both the quenched free energy and the annealed free 
energy are convex functions of /3. 

Let us briefly mention a variant of the above model. On the same configuration space and 
with the same random variables ^, we define macroscopic random order parameters 



1 ^ 

mnu^]i^)^j^J2^^a,. (1.10) 



1=1 



^Note that physicists often use a different normalization, Fj^^p = lii-^Ar,/3- We use Talagrand's choice 

convention to facilitate comparison with [T4]. 
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These parameters are considered as components of a vector in R-'^(^) with M{N) as in (1.4). 
New Hamiltonians are now defined through 

HN[u;]{a) - ^ (llmM(a)ll^ - E ||mM(a)||^) , (1.11) 

Op 

where s = ,Sp > is defined such that the covariance of H is in leading order in A'^ equal to 
aN. The interaction ^ is a straightforward generalization of the usual p = 2 case. However, 
computing the resulting covariance function one sees that it decreases only quadratically 
with the Hamming distance. Therefore it will not share the special features of the p-spin SK 
model. An analysis of the high-tcmpcrature phase for H has been presented in [Nil]. 

We will now state our results. They will always concern the model with Hamiltonian (1.3) 
and p > 4. 

The first result wc prove for both choices of the Hamiltonian is that for high enough 
temperatures (that is, low values of /3), the limit of the annealed free energy exists. 

Theorem 1.1: If P < e~^{p\)^ = /3p, then the annealed free energy corresponding to H 
satisfies 

F^^,^ = ^{1 + 0{N-')). (1.12) 



Note that for larger values of (3, the annealed free energy diverges. Our analysis will be 
limited to the case when f3 < [3'^ where a comparison to the SK model is still possible. It is 
nice to see that this value tends to infinity with p very rapidly. Moreover, we shall see that 
this value becomes much larger than the critical temperature, as a gets large. 

Jensen's inequality implies that the quenched free energy is less then or equal to the 
annealed free energy, 

EFiv,/3 = \nZM,p < ^ IuEZat,/? = F^y (1.13) 

We define the critical temperature to be the infimum of values for which equality holds in 
(1.13), i.e. in terms of /3, 

pp = sup {/? > : limsupEFiv,/3 = limsupF^"^}. (1.14) 

Observe that in general lim^EF/y^^ need not exist. 

By (1.8), as a random process on Sn, Hn{<^) has (up to an overall factor) essentially the 
same covariance structure as the p-spin SK Hamiltonian. This suggest that as in that case, 
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for p large the model should be similar to Derrida's random energy model (REM) [Dl,D2]s 
Recall that in this model, HN{a) = y/NX^^, where {X^}^^Sn i-i-d- standard normal 
random variables). Defining the corresponding partition function = Eo-e^^^'', one 

easily sees that the free energy satisfies [D2] 

fREM ^ InZ^T = \ " . 1-15 

'f^ N^^N ^'^ 1 /3V2hr2-ln2, if /? > ^21^72 ^ ' 



We will show that as p tends to infinity, y/aPp tends to the critical value \/21n2 of the REM. 
Moreover, pointwise in a, 

^ A-S. -v'L- > ^".v^" = ^-f-?™- (i-is) 

in analogy to the situation in the p-spin SK model [T6] . While this may not be very surprising, 
it is also not totally obvious and will require some non-trivial computations. 

Our next two theorems make these relations precise. We will denote by I{t) the Cramer 
entropy function, 

m = ^(1 - -t) + l{l + t) ln(l + t), (1.17) 
Theorem 1.2: The critical value (ip = (3p{a,) satisfies 

I3p{af > min ( inf /(i)^^ | = /3p(a)^ (1.18) 



4 te[o,i] oitP 



Furthermore, if a > ^ ^j"^ = then 



Pp{af<'^=P{af. (1.19) 
a 



Remarks: (i) One can show that the inequality (1.19) actually strict. In [B2] it is shown 
that for the SK case, /3p > V21n2(l - Cp) with Cp = 2-p(4+0(Vp)). This follows from a 
corresponding upper bound on the supremum of Hn (cr) which can be obtained using standard 
techniques. These estimates can without doubt be carried over to our case. 

(ii) The bounds on the critical temperature are essentially (up to a factor -y/a) the same 
as for the p-spin SK-model ([T4], Theorem 1.1).''' 

^Observe that in [T4], the normaUzation of the Hamiltonian contains an extra factor 2~^/^. 
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By elementary analysis one finds that, as p tends to infinity, 

^inf ^((1 + t-'p)m)'/' = Vm2 (l - ^) + 0{p'2-'n- (1-20) 

This, together with the convexity of the free energy in /3, will allow us to prove the following 
statement. 

Theorem 1.3: As p ^ oo, the lower bound $p t /3. Moreover, for all ^ >Q and a > 0, 

H°^lt°^ 4^^^-/^ = /#cf-v- (1-21) 

pjoo iVjoo iV ^ 

The basic strategy used to prove these results are rather general. In Chapter 2, we will 
explain them by means of the analogous calculations in the REM. For now, we just mention 
that the hard part is to prove the lower bound (1.18), whereas the upper bound (1.19) is 
comparatively easy and will follow from an estimate on the ground state energy. 

An important point in the study of disordered models is the question of self-averaging of 
the free energy. While in many cases this follows from general principles [MS,T1] of mass 
concentration, due to the failure of certain convexity properties, it turns out to be surprisingly 
difficult to prove the following result* 

Theorem 1.4: For all P,n,T,£ > there exists C„ < oo (depending only on n and j3), 
and N < oo such that the free energy satisfies 

\Fn^0 - EFjv,/3| > TpN-^+A < CN-"" (1.22) 

for all N > N. In particular, 

lim |Fjv« -EFjv,/3| = 0, P-a.s. (1.23) 



Remark: From recent results in the p-spin SK-model and the REM [BKL], one actually 
expects that the fluctuations in the small /3 region are of much lower order. 

While the critical temperature is defined in terms of the behavior of the free energy, it 
turns out that this phase transition goes along with a change in the behavior of the replica 
overlap parameter, RN{a,a'). This will eventually lead to rather detailed insight into the 
properties of the Gibbs measures at low temperatures. 

The crucial link between the two will be provided by the next theorem. 

®A sharper estimate can be proven with much less effort for the interaction -ffjvi see [Nil]. 
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Theorem 1.5: Assume that (3 < ^0p- Then the replica overlap RN{a,a') satisfies 

^-^=a(i{l-¥.gM,p®QNARN{cT,a'Y\){l + 0{N-^)), (1.24) 



Note that in the case of the Gaussian SK models, this relation is a trivial consequence of 
the integration by parts formula 

E[gf{g)]=E[g^]E[f'{g)], (1.25) 

which holds for any centered Gaussian random variable g and any function / not growing 
faster than some polynomial at infinity. To establish this result without the help of this 
formula turns out to require a considerable effort. Similar tools are also instrumental in the 
proof of Theorem 1.4. 

We then have the following consequence to Theorem 1.2 and Theorem 1.5. 

Theorem 1.6: Assume that a> Op. If (3 < (3p, then 

limsupE^jv,^ ® ^iv,/3[i?iv((T,a')1 = 0. (1.26) 

JVToo 

Conversely, if lim supjy E ^ q"^''^ < 0.(5, then 

liminf Egjv,/3 (8) QnARn{(t,(t'Y\ > 0. (1.27) 
In particular, (1.27) holds for all (3 G \l3'p). 

Remark: It seems reasonable that (1.27) should hold for all [3 above the critical [3p, but 
there seems to be no general principal that would prohibit a reentrant phase transition. 

Inequality (1.27) expresses in a weak way that below the critical temperature, the Gibbs 
measure gives some mass to a a small subset of the configuration space. This result can be 
strengthened. As in [T4], we show that the overlap between replicas is either very close to 
one, or to zero: 

Theorem 1.7: For any e > there exists po < oo such that for all p > po, a > ap, and 
for allO<P<P'p 

hm EG^^^ilR^ia, a')\ e [e, 1 - e]) = (1.28) 

//, moreover, P < 0p, then for any e > there exists po < oo such that for all p > po, such 
that for some 6 > 0, for all large enough N, 

SN 



mT{\RN{a,a')\ G [e,l]) < e"^^ (1.29) 
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Remark: Note that we prove this result without any restriction on the temperature, while 
Talagrand requires some upper bound on (3 both in [T4] and in the announcement [T5] even 
though the bound in [T5] is greatly improved. We stress that the our result is also valid for 
the p-spin SK-model. The same applies for all subsequent results. 

The information provided by Theorem's 1.6 and 1.7 allow gain considerable insight into 
the nature of the Gibbs measures in the low temperature phase. This observation is due to 
Talagrand. 

In [T4] he showed that whenever (1.27) and (1.28) hold, it is possible to decompose the 
state space Sn into a collection of disjoint subsets Ck such that 

(i) 

hm Egf {{ia,a')\ |i?iv(a, a')! > e}\ Ck x C^) = (1.30) 

A* f CXD 

(where the Ck depend both on N and on the random parameter!), and 
(ii) If a, a' £ Ck, then R!\[{cr, a') > 1 — e. 

Note that because of the global spin flip symmetry of our models with p even, these lumps 
necessarily appear in symmetric pairs. 

In [T4] Talgrand analyzed the properties of these lumps further using the cavity method. 
He showed that, under a certain hypothesis that we shall discuss shortly, for f3 not too large 
this lumps correspond to what is known as "pure states". While it is very likely that this 
analysis can also be carried over to our models, wc will leave this question open to further 
investigation. Wc find it however interesting to discuss the situation of the general hypothesis. 
Talgrand's hypothesis in [T4] concern the distribution of mass on the lumps. Roughly, they 
can be states as 

Theorem 1.8: Assume that ^/3p > /3 > /3p. Let Ck be ordered such that for all k, 
QN,p(Ck) > QN,i3{Ck+i)- Then for all A; G N, there exists pk < oo such that for all p > Pk, 

lim EgN,f3 {utA) < 1 (1-31) 
except possibly for an exceptional set of (3 's of zero Lebesgue measure. Moreover, for k large, 

2 Infe 

In [T5] Talagrand has announced a proof of an even stronger theorem in the p-spin SK 
model that makes use of general identities between replica overlaps proven by Ghirlanda and 
Guerra [GG]. We show that at least Theorem 1.8 also holds in our model. 
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A final result is particular to the Hopfield model and concerns the storage properties of 
the model. Newman has proven in [Nl] that for small a, the Hamiltonian has deep local 
minima in the vicinity of each pattern. Here we show a somewhat converse result, stating 
that if a is not too small, then small neighborhoods of the patterns have asymptotically mass 
zero. In other words, none of the patterns falls into one of the 'lumps'. This gives the final 
justification to call the phase transition we have observed a transition to a genuine spin glass 
phase. 

Theorem 1.9: Suppose that a satisfies aPp{a) > Then there exists a 5 G {0, |) 

and N eN such that for all N >N, 

M{N) 

P[argsup|//iv(a)| G \J S^l^^)] < iV— , (1.32) 

where Bs(^^^) is the N5-ball around in the space with respect to the Hamming met- 
ric. In particular, there exists an agp = asp{p) such that (1.32) holds for all a > Usp. 
Furthermore, 

M(N) 

argsup|i?jv(cr)| ^ |J eventually P - a.s. (1.33) 

The proof of this result is based on the comparison between the ground state energy of the 
system and an estimate on the values of the Hamiltonian in the balls around the patterns. 
While the former increases as N^/a, the latter is almost constant and with high probability 
close to N{p])-'^/'^. 

The remainder of this paper is organized as follows. In Chapter 2, we explain the ideas 
behind the proof of the bounds on the critical temperature by calculating the corresponding 
quantities in the REM. In Chapter 3, Theorem 1.1 is proved. Chapter 4 is devoted to the 
lower and the upper bound on the critical /3 (as well as the proof of Corollary 1.3). In 
Chapter 5 we prove Theorem 1.4 In Chapter 6 we prove the results on the distribution of the 
replica overlap. Theorems 1.5 to 1.8. In Chapter 8 we prove Theorem 1.9. 

2. Second Moment Method: The REM 

This section is meant to give a pedagogical exposition of Talagrand's truncated second mo- 
ment method [T3,T4] in the context of the simplest possible setting, the random energy 
model. A more detailed exposition can also be found in [B2] and [T6]. Since the application 
of this method in our case will become rapidly somewhat technical in our case, we still find it 



12 Chapter 2 

useful to give the reader an outline in a non- technical context^. Moreover, the REM provides 
important bounds for the real model. 

We will now show how this method works by using it to compute the free energy of the 
REM. Note first that in general, 

^ = —GnAHn] < ^n^np\H^{a)\]. (2.1) 

Moreover, since 

P[sup|i7jv((7)| > tN] < 2^¥[\HN{a)\ > tN] < (2.2) 

cr 

from this it follows easily that 

oo 

^E[supHN{(T)]<V2h[2 + 2 j e-^(^-'"2)di 

V2hr2 (2.3) 

1^' 

This is the upper bound on the derivative of the expectation of the free energy. Suppose now 



< V21n2 + iV" 



that (5 > -\/21n2 = (5' . Convexity of the free energy then implies that 

E Fjv,/3 < E Fm,p' + (/? - /?')/?' (2-4) 

and in the limit 

hmsupEF^r,;? < + = ^ _ (/3 _ p' f < ^, (2.5) 

which by definition means that > /?rem- In the case of the p-spin Hopfield model, the 
corresponding calculations will be identical to those above, except for the bounds on the ex- 
trema of the Hamiltonian, where the non Gaussian character induces somewhat more involved 
calculations. 

The basic idea behind Talagrand's approach to prove the lower bound (which he did for 
the p-spin SK-model in [T4]), is to obtain a variance estimate on the partition function. This 
will imply that the expectation of the logarithm behaves like the logarithm of the expectation 
of this quantity. In the REM, one would naively compute 

E {Z^^'^\ = E^,<,,Ee'^^(^='+^-') 

\ct/<t' a J 

= e^^' [(1 - 2-^) + 2-^e^^' 



''Note that of course much sharper results than those presented here can be obtained in the REM when 
making use of its special features. See e.g. [BKL] for a full analysis of the fluctuations of the free energy. 
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The second term in the brackets is exponentially small if and only if (3^ < In 2, and this 
cannot be the critical value since it violates the upper bound /?' above. ^° The point is that 
while in the computation of E ^^^^'^ ^ the dominant contribution comes from the part of 
the distribution of around = 2/3-\/N, whereas in E the main part is contributed 
by Xcr around Ps/N. One is thus led to consider the second moment of a suitably truncated 
version of Z^^. Namely, for c > 0, 

Z^Jic) = E.e^^^'I^^^<,^j. (2.7) 

One then finds that (modulo irrelevant prefactors) 



KZ-,y{c) = { 



6 2, if p < c, 



^^^-^,if/3>c. 



Moreover, for /3 < c, 



and thus 



{X„<il+e)l3VN} 

g-iV(l„2-/3^)^ if/?< 



< (EZjv,/3)' X <^ 



-JV(c-/5)2-JV(ln2-i^) 



2' 

if f < /3 < c. 



■^This is already contained in [D2] 



(2.8) 



EZ„,,(c)=EZ.Jl-^=^l (2.9) 



On the other hand, 

EZ^,^{cf = (1 - 2-^) (eZ^,^(c))' + 2-^Ee2^^^^<'I^^^<,^j, (2.10) 
where the second term satisfies 



(2.12) 



(2/3-c)-/N 

Hence, for all c < \/21n2, and all /3 7^ c 

E (^iV,/3(c)-E%/3(c))" ^ g-iVg(c,/3) .2 13) 

E[^^r,/3(c)2] - ' ^ - ' 
where g(c,P) > 0. Thus, by Chebyshev's inequality, it is immediate that 

lim ^E lnZjv,/3(c) = lim — InE ZAr,^(c), Vc < v'21n2. (2.14) 
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Since this gives a lower bound of the free energy that is as close to the upper bound as desired, 
we see that the upper bound gives in fact the true value. 

This is a remarkable feature of the REM: the expectation of the logarithm of the partition 
function coincides with the log of the expectation of a suitably truncated partition function. 
While this is rather special to the REM, the method is general enough to provide lower 
bounds in the far more complicated situations, as we will see. 

3. The Annealed Free Energy. 

In this Section we compute the anneled free energy. Apart from the intrinsic interest this can 
be seen as the computation of the log-moment generating function of the Hamiltonian and 
this will be a basic input in the sequel. While in the SK models this is a two line computation, 
here even this will require a considerable effort. The idea is to use Taylor expansions and to 
exploit the fact that the Hamiltonian is a sum of a very large number of independent random 
variables. Namely 



EZn,p = Ee" 



-/3HjvH(<t) 



M{N) 

= n 



E exp /3 



E exp /3 




(3.1) 



where we introduced the abbreviation Y = N 2 ^j^-p^ ^j. We now expand the exponential 



function according to the bound 

exp P 



X 2 



< IxPel^l. Thus, 



E 



P 



Y 



< E 



- 1 - 



|ypexp 13 



NP-2 



\Y\ 



(3.2) 



+ OiN^-P). 



Observe that the quadratic term is in fact just Np~^ times the variance of H^. We will show 
in a moment that the expectation on the right-hand side of (3.2) is bounded by a constant 
times ^ . Assuming this and recalling that p > 4, it is evident that 

^ (3.3) 



InE Zn 



M{N) In 



1 + 



(l + 0(iV-^)). 



Annealed Free Energy 
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which is what we want to prove. We now turn to the non-trivial part of the proof, the estimate 
of the remainder on the right-hand side of (3.2). To to this, we decompose the exponent into 
two factors, and use on one the obvious bound \Y\ < {p\)~^ N^^^ . This yields 



E 



l^l^exp (/3(p!)^ivV|r|^ 



= E 
< E 



2-p , , 2 , , p-2 \ 

^N~\Y\7\Y\— j 



l^l^exp (/3(p!)^ 
|y|^exp (|/?(p!)i-^|F|i) 



(3.4) 



The point is that the term should behave almost like the square of a Gaussian. More 

precisely, we have the following bound. 

Lemma 3.1: Let {-'^i}i=i,... ,Ar be a sequence of i.i.d. Bernoulli variables, taking values 
+1, —1 with equal probability. Then^C G (0, e~^), there exists an e'q < oo (depending also 
on p) and an N eN such that for all e > e'q 



TeVN lex 



> e 



< 2exp -C 



,2(p!)f 



(3.5) 



Proof: The proof is surprisingly more involved than what one might at first suspect (at least, 
if optimal constants are desired). We shall show that 'YlxeVN ^ function of YliLi-^i 

only. Since the distribution of this latter random variable is well known, all we have to do is 
to find an accurate upper bound for the function relating the two quantities. And since we 
are only interested in the tail behavior, we can restrict our attention to large values of the 
sum (large meaning at least of the order of s/N). 

Suppose that YliLi = ^ — 2^- Then the quantity YIteVn given by 

J:x, = ±i-l)^ (l) - ^) = L^^J [(1 + - zY] , (3.6) 

where [z^J (•) = " is the operator which extracts the coefficient of the term from 

^' z=Q 

a formal power series. Note that it will be important to take into account that the sum in 
(3.6) is oscillating to get a useful estimate. To do this, we consider the polynomial on the 
right-hand side of (3.6) as an analytic function C — C and use Cauchy's integral formula to 
write 

[zP\ [(1 + z)^-\l - zY] =^.j z-P-^{l + z)^-\l - zY dz, (3.7) 

for any closed path C surrounding the origin counterclockwise. To evaluate this integral, we 
apply the well known saddle point method (see for instance [CH]). We choose C to be a circle 
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around the origin with radius 



Suppose that ^^^j^^2i)^ < k < 1. Then the argument of the square root is positive. Moreover, 
the following bounds for r hold, 

^ <r<-^(l + Ci(Ac)), (3.9) 



N -21- - N -21 
where Ci increases from zero to some finite constant as k, varies from zero to 1. 



Indeed, \/l — x is C°° for all |xl < 1. Therefore, for all k < 1, we can find a C > such 
that \/\ — X > 1 — f — Cx^, for all \x\ < k. Obviously, C tends to | as k tends to zero. This 
implies the upper bound. On the other hand, \/l ~ x < 1 — |, for all x > — 1, which yields 
the lower bound. 

The contour integral in (3.7) then becomes 



/ / z-^-^{l + zf-\l - zf dz 

2m J a 



-— [ expi-ip-dlnr + iN -l)ln{l + re''^) + lln{l-re''^)) d^= — [ e^W 
2-jT J ^ 27r 7 



-TT 



(3.10) 

As usual, we expand the function g around its maximum (which happens to lie at i? = 0) and 
try to control the error. This yields 



/ = exp L(0)+(^ sup g('H0] f e'^^'^'^'U^ 

(3.11) 



= r-P{l + r f-\l-rye^vl^^ sup g^'\o] J e'^^'^'^'^U^ 



The main contribution comes from the term r ^(l+r)-^ '(1— r)'. Using (3.9), this is bounded 

by 

r"P(l + r)^"'(l - rY = exp (-plnr + {N - I) ln(l +r)+l ln(l - r)) 

< exp (-P Inp + p ln(iV - 21) + {N - l)r - Ir) 

< exp (-plnp + pln(iV - 21) + {N - 2l)r) ^^'"^^^ 
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The integral in (3.11) is explicitly 



(N ~ l)r 
rf ~ (l + r)2 



1/2 



TT 



(iV-Or- _ /r 
(l+r)^ (1-r)^ 



and can be bounded by (for all A?" large enough) 



{N-iy 



i- 



<p-2 1 



{N-21Y 



(3.13) 



(3.14) 



(l + r)2 {l-rf. 

Finally, we estimate the error due to the remainder in the Taylor expansion in (3.11). One 
shows by a straightforward computation that for all (5 > there exists an TV^^^ G N such 
that 

<p(1 + Ci(k))(1 + k(1 + Ci(k))+(5) =pCz{n,5), (3.15) 
where C3 = 1 for «; = 5 = 0. Hence, the error committed can be bounded as (if > -/V^.a) 

/ (27r)3 



exp 



sup g^^\0 1 < exp ( ^p{l + Ci(k)) ( 1 + k(1 + Ci(«)) + 



3! 



Ce[-7r,7r) 



27r 



3! 



C2 
iV-2/ 



This follows from the exact expression for g^^^ , 



g^^\'d) = ire''' [{N-l) 



re^^ - 1 



-I 



1 + re 



i-d 



(1 + re^'^)3 {rei^ - 1)V ' 
which one gets through straightforward derivation. 

Inserting the bounds (3.12), (3.14), and (3.15) into the estimate (3.11) then gives 



(3.16) 
(3.17) 



5))p 



and thus 



)+C3{k,5)) 



(3.18) 



(3.19) 



Let p{k,6) = e('^i('')+^3(«,5))p^ fQj. ^ ^ (0,1) and > 0. Then p is increasing in k and 
bounded below by e^. Thus, for all C G (0, e~^), we can find k G (0, 1) and 6 > such that 
C < p{k,S)~^. Let now 

^ /4py/2^(M) 



£k,6 



K J 



pi 



(3.20) 



Suppose that e > e- ^ and N > N-g. Then, we have that 



iV-V2^X,> (£p!p(;^,^)-i)'^'' Kexpf-^^eplpikrsr^y^"), (3.21) 
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by the standard bound on sums of Bernoulli variables. On the other hand, since 

1 /2 

iV- V2 ^ X, > (ep\ p{k, ~d)-') > {e,^^p\ pik, ~5)-') = (|) (3.22) 



implies that 



-IpN 



< K <1, 



(3.23) 



{N - 21Y 

the condition following (3.8) is satisfied and hence the above bound on fiYlieX-^i) valid. 
Thus 



i/p 



p{h,d) 



pi 



> s 



> 



(3.24) 



Hence, by (3.21) and (3.24), 



N-P/^f{J2Xi)>s 



\ieAf J 



< exp (-1 (^ep\p{k,~S)-'y^''^ < exp (^-^(sp\)Vp'^ . (3.25) 



Thus, we have shown that for all C G (0, e~^), there exists = e~ ^ such that (3.25) holds 
for all e > ic and all N large enough. Together with the analogue bound for the negative 
tails, this proves the lemma. □ 

To finish the proof of the theorem, let us go back to (3.4). To get the claimed bound, it is 
enough to show that the integral on the right-hand side is bounded uniformly in N. Indeed, 
since the variable Y satisfies the bound (3.5) of the lemma, we get for any C < e~P 

E [|ypexp {Pip\)i-^\Y\i)] [\Y\%^Y\eli,i+i)} exp {Pipl)i-^\Y\i)] 

i>i 

< (Z + l)^P[|y| > Z] exp (^(p!)i-5 (/ + !)!) 

OO 

< J {x + lfexp{(3{p\)p-^{x + l)i -C'^^P{p\)ixp)dx 



(3.26) 

By the preceding lemma, for any (3 < e~^(p!)^, we can find C < e~P and a corresponding 
£'(-;, such that the above integral is finite. Setting = C, this proves the theorem. □ 

We observe that we could have equally well replaced Hj\[ by in —Hjy in the proof of Theo- 
rem 1.1, without changing the result (since only the square of the Hamiltonian does enter). 
We therefore have readily the following result, which we state for further use. 
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Corollary 3.2: // |/?| < then 

Proof: Completely analogous to the proof of Theorem 1.1. □ 
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(3.27) 



We also put a result here, that will be used in the next chapter, but whose proof is very 
similar to the above. 



Lemma 3.3: // \f3\ < i^P'p, then there exists a constant C > such that 



E 



-l3HN{cr)-l3HN{cr') 



< gaAr/32(H-fl(a,a')^+C) 



(3.28) 



for all N large enough. 



Proof: The proof is actually almost identical to the proof of Theorem 1.1. We start by 
expanding the exponential up to order two, with the same error as in the proof of Theorem 1.1 
(inequality (3.2)). This error term is then treated similarly, by first decoupling the terms in 
a and a' with Cauchy-Schwarz. This already shows why P has to be less than half the bound 
of Theorem 1.1. The linear term in the expansion vanishes, whereas the quadratic term gives 
us the covariance term R{a,a')P. Indeed, if we set y*(cr) = N'p/"^ Z^icA/'^i^i' ^® S®* 



InE [eM-PH^icr) - PH^ia'))] 

M(N) 2 , 

< In ( 1 + ^N^-P¥. [(y'^(a) + Yi'^a'))' 



(3.29) 



+ 



-iV3-¥E 



\Yl'{a)+Y^'{a')\^e■KY> {p{p^?)^ N^-^\Y^'{a) + Y^'{(T')\^ 



We now apply the triangle inequality and Cauchy-Schwarz to the error term, which yields 
7V3-^E + yM(^/)|3e^(p!)^/^iv--/=|r-(a)+y-(a')r 

3 1 

< iV^-* ^ (^E [|F'^(c7)|2J exp (2/3(p!)5iVi-f ^ 



(3.30) 



(e [iF'^(a') I*^"'^' exp (2(5{p\)^ N^' § \Y'' {a') |) ] ) 



3p 



if /? < and A'^ large enough, by the result in the proof of Theorem 1.1 (cf. the remark 
after (3.2)). 
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The quadratic term in (3.29) is evaluated easily. One obtains (observing that the covariance 
of Hn appears) 



E 



(3.31) 



-{l + R{a,ar) + OiN-'). 



Hence, 



lnE( 



M{N) 



Co 



(3.32) 



that is, 



< M(iV)(/32Ar2-P(i + i?(^, a'f ) + C^N^-p), 



(3.33) 



This proves the lemma. □ 

Finally, we have as an application of Corollary 3.2. 



Lemma 3.4: The Hamiltonian satisfies 
P sup|iyjv(o-)| > tN 



< C{ 



cxp(-iV(|^-ln2: 



if t < 



a(p\) 2 



exp ( -N{^t - f4 - In 2) ) , otherwise. 



(3.34) 



Proof: Wc start with a crude bound to extract the supremum. Standard arguments and 
Chebyshev's inequality in its exponential form yield 

P[sup \Hn{(t)\ > tN] < 2^ inf e-«*^E e«^'^('") + 2^ inf e'^^^Ee-'^^''^''^ (3.35) 

We now use Theorem 1.1, respectively Corollary 3.2 to bound the two integrals and obtain 

¥ sup \HN((T)\>tN <Ci2^+^ inf e-«*^e^ 
.a J 9e(o,/3p 

'exp(-iV(|i-ln2)), ift<^, (3-36) 

exp (-N{^t - ^ - In 2) y otherwise. 



Col 



This proves the lemma. □ 
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4.1. Estimates on the Truncated Partition Function. 



To get the lower bound for the critical temperature, we would like to compare E Zff g and 



(EZjv,/?)^. However, as mentioned in the introduction and explained in Chapter 2 it is 
essential to do this comparison for a truncated partition function. Define therefore 



(4.1) 



for c > 1. The key observation is that the truncation has no influence on the expectation of 
the partition function if c is chosen appropriately. This is the content of the following lemma. 

Lemma 4.1: For all P > 0, c> 1 such that (3c < (3'^ there exist K,K' > such that 

EZnAc) (l - i^e-^'(^-i)'^) EZa,,^. (4.2) 

Proof: Let us set g = g(Ar) = Q;/?2iV. Note that E Zjv,^-E Zjv,^ = E [e-^^^('')l{_^ij^(<,)>cq}] 
and thus by the exponential Chebyshev inequality 



E Zn,i3 - E Zn,i3 < inf e"*'=«E 



-/3(l+t)HjvH 



(4.3) 



We now use Theorem 1.1 with f3 replaced by (1 + t)/? to estimate the expectation to get 



inf e-*^«E 
t>o 



-/3(l+i)Hjv(<T) 



< 



inf ( 

0<t</3//3;-l 



(4.4) 



The exponent is minimized for t = c — 1. By assumption, /9c < f3'p, so that this value falls 
into the interval over which the inf on the right is taken. Thus, 



inf 6"*^=^ 



-l3(l+t)HN{cr) 



This implies the statement of the lemma. □ 

We now turn to the square of the truncated partition function. We bound 

EZ^^^Ee"'^-^^'^^"'^-^^'^ ^'S-{-HN{<T)<cal3N}'^{-HN{<T')<cal3N} 



(4.5) 



(4.6) 



by two different functions. When calculating the expectation with respect to a and a' , we 
use one bound for small values of the replica overlap R(a,a'), and the other for the rest. 
Define therefore 



)l<6} 



(4.7) 
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T{c,b,b') = E,,,, [e-^(^'^(")+^^("'»lI{|fl(<.,<.0|e[6,6']}I{-/3(^/ivW+if^(a'))<2ca/3=iV}] • (4.8) 

Then 

Z^A^^f <S{b) + T{c,b,l), (4.9) 
for all b G (0, 1). We now control each of the terms separately. We start with S{b). 
Lemma 4.2: Suppose (3 < and b is such that 



Then for all e G (0, | — 7) there exists A^e G N such that for all N > N^, 



ES{b) < 



Vl-2(7 + £) 



(4.10)) 



(4.11) 



Proof: If P satisfies the above condition, we can apply Lemma 3.3 to the integrand of the 
right-hand side of (4.7). One obtains 



E 



Thus, 



< I{|fl(a,a')|<6}e 



(4.12) 



E5(6) <E, 



a, a' 



,aP^N{l+R{a,a'r+CN-^)-^ 



e ' ' i^{\R(a,a')\<b} 



JV(l+fl(a,a')'6^-'+CiV-i) ir 



)\<b} 



N/2+[bN] 



^al3'^N(R{a,a'fbP-'^+CN-^) 



(4.13) 



k 



k=N/2-[bN] 

by assumption (4.10), for any e > 0, if iV is large enough. Standard estimates then yield 

(4.ii).n 

The next result concerns the term T{c, b, 1) in (4.9). 

Lemma 4.3: Let I{t) he the Cramer Entropy as defined in (1-17). Suppose that there 
exist c > 1, d > 0, such that 



Vte[6,6'], 2a0^c[l 



2(1 + tP) 



< a0^ + I{t) - d. 



(4.14) 
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Then, if 



1 



c<inm(— /?;,! + 



there exists N E'N such that for all N > N, 

ET(c,6,l)<e"'^'^e-^. 



(4.15) 



(4.16) 



Proof: By definition, 



ET{c,b,b') =E^^„,E 



^-l3(H(a)+H(a'))-n -ir 



■ (4.17) 



In a first step, we bound tfie expectation over the disorder for fixed a, a' . Similar to the proof 
of Lemma 4.1 we get (again q = a(3'^N), yields 



E 



'^{-l3{HN{(7)+HN{a'))<2cq}e 



-l3{HN{a)+HN{a')) 



< inf e2*^^E 



-l3{l-t){HN{cr)+HN{a')) 



(4.18) 



We now use Lemma 3.3, with P replaced by /3(1 — t) to obtain 



inf e2*^«E 



-/3(l-t)(i?ivW + i?iv(<T')) 



< inf e2tcgg(l-t)^,(l+R(a,a')-)gC.iV-ig_ ^^-^g^ 



*>l-/3;/(2/3) 



The infimum is attained for t = 1 — (^i_^j^p-j > 1 ~ 2^ assumption (4.15). Thus 



E 



^-/3i?jv(o-)-/3-H"iv(CT')ir 

e ' ' ' ii-{-/3HN{cr)-l3HN{cr')<2caf3N} 



(4.20) 



Finally, wc integrate over all configurations a, a' satisfying \R{a,a')\ G [^'j We observe 
that R{a, a') has the same distribution as S{a) = J2iLi ^i- Hence, 



E 



T(c,6,6') 



= C3E, 



exp 



(^'"^'(^ " 2(l + i?(a,a')^))j^^'^^'^'^'^'^^'''''^^ 

c 



(4.21) 



2a/?2c(l 



< 2C3Arexp AT sup 

V te{b,b'] 



2(1 + iP) 



/(t) 
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The second to last inequality follows from the hypothesis of the lemma, and the observation 
that we sum over at most 2N values of S{a). The last inequality holds for all N larger than 
a certain TV G N. Since this estimate is uniform in 6', we may choose b' = 1. □ 

From the preceding results, we now get a variance estimate for the truncated partition func- 
tion. 

Proposition 4.4: Suppose that f3 < $p. Then there exist constants C > and c > 1 such 
that 

E[iiv,/3(c)'] < C(EZN,p{c)f. (4.22) 

and, 

nZwAc) > l^Zr^Ac)] > ^- (4.23) 

Proof: We first prove that the hypothesis implies that the assumptions of Lemmas 4.1-4.3 
are satisfied. Consider therefore /? < such that 

inf /(t)i±^. (4.24) 

o<t<i ^ ^ atP ^ ^ 

Then it is immediate that 



for all t € [0,1]. By continuity, there exist c* > 1 and d* > such that Vc G (l,c*) and 
de (0,d*) 



This implies the hypothesis of Lemma 4.3. 

We now show that (E [.^at])^ is of the order of E [.Zjv^]. We start by fixing the free pa- 
rameters b, b', and c. Choose first b such that 7(6) = | (or any other constant less than one 
half). Then choose c such that 

c<mm(^c*,^,l + Fy (4.27) 

Then the hypotheses of all preceding lemmas are fulfilled. Finally, choose b' = 1. By 
Lemmas 4.2 and 4.3, we then have 

E [Zn^] < E [S{b) + T{c, b, 1)] < (Ci + e-^'^/^^ga/J^iv^ (4 23) 
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The right-hand side is by Theorem 1.1 bounded by 

(Ci + e-^'^/2)e«'3'^ < 2(72 (e [^at]) (4.29) 

which in turn is of the order of (E [-^at])^ by Lemma 4.1, so that 

(Ci + e-^'^/2)e"^'^ < Cs (e [Zn])^. (4.30) 



This imphes (4.22). The second assertion of the proposition follows from the Paley-Zygmund 
inequality, which states that for a positive random variable Y and any positive constant g, 

y>5EyJ >(i-5)^^^. (4.31) 

This relation gives us a lower bound on the probability that Zj^ > gE [Z]\f], which is strictly 
greater than zero and uniform in A^. Indeed, if we set g = ^ in (4.31), then, by (4.22), we get 

¥[Zm>^EZm] (4.32) 
This concludes the proof of the proposition. □ 
4.2. Proof of the Lower Bound. 

We will now proof the lower bound assuming that Theorem 1.4 holds. This is by now quite 
standard [T1,T2,T3], but we repeat the argument for the reader's convenience. Note that by 
Lemma 4.1 for N large enough, for any 6 > 0, 

P [Zn >^EZn] <F[Zn>^{1- 6)E Zn] . (4.33) 

But 

^ Zn> ^(1 - S)EZn] = F[Fn- EFjv > N-\lnEZN - ElnZjv - In Q(l - S)^ 

(4.34) 

But Theorem 1.4 implies that this quantity is smaller than B~"-, if 

N-\lnEZN - ElnZiv) > iV-^/^+e (4 35) 

in contradiction to the lower bound (4.32). This proves that for P < $, 



lim N-^(lnEZN -EIuZn) = 



(4.36) 
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proving the lower bound on /3p. □ 



Remark: It should be noted that the above argument requires only an upper deviation 
inequality for the free energy. Such an inequality can be obtained in a much simpler way 
than Theorem 1.4 (in that it does not require the results of Section 5) on the basis of a result 
of Ledoux [Le]. The reason is that while the free energy is not a convex function of all the 
disorder variables, it is separately convex in each This suffices to apply Ledoux's theorem. 
A proof of the corresponding one-sided inequality can be found in [Ni] . 

4.3. Upper Bound on the Critical /?. 

The proof of the upper bound in Theorem 1.2 is considerably simpler than the lower bound. 
By (2.1), E < A'^~^E sup^ |i7jv(cr)|, while Lemma 3.4 yields immediately (see the argu- 
ment leading to (2.3)) that: 

Lemma 4.5: There exists C <oo, such that: If a> then 

E sup \HN{a)\ < NBa + C (4.37) 

cr 

where 



Ba = < 



( V2aln2, if a > 



(4.38) 



Let /?oo = Ba/a and assume that a > Up. Now assume that (3p > (5oo- Then for 
Poo < /3 < we have that 

limsupEFjv(^) < limsupEFjv(/?oo) + +(/? - /3oo)S„ 

(4.39) 

in contradiction to the assumption that P < Pp. Thus Pp < Poo which proves the upper 
bound (1.19). □ 

4.4. Convergence to the REM: Proof of Theorem 1.3. 

The convergence of the free energy as p | oo follows now from a simple convexity argument. 
Note that for all P < Pp, limAr|oo EF/v^^ = f^'^^, while for all P > Pp, by convexity of -F/v,/?, 

hminf EF^,^ > liminf EF^ + aPpiP - Pp) 

= ^ + aPiP - P) 



Fluctuations 



27 



while on the other hand 



Urn sup E Fn^h < Urn inf E ^ + aPp {P - Pp) 



provided p is large enough such that a > ap. But since linipjoo $p = linip|oo Pp, the two 
bounds above both converge to f^^^, as p j oo, for any a > 0. This proves Theorem 1.2.0 



... include definition file 
5. Fluctuations: Proof of Theorem 1.4 



The main line of reasoning of the proof of the fluctuation theorem is as follows. First, for 
each N we define a set whose complement has a very small probability (of the order of A^~"). 
On this set, we prove the estimates on the deviation with the so-called Yurinskii martingale 
method [Yu]. On the complement, we simply use that the free energy is bounded by a 
polynomial function. This approach was first used in the context of the mean field model in 
[PS, ST] for variance estimates and in [BGP2,B1] for exponential inequalities, but has later 
been made obsolete by new concentration of measure inequalities provided by Talagrand 
in [Tl]. Unfortunately, these require convexity of the level sets of the random functions 
considered which in the current situation do not appear to hold. Although, as remarked at 
the end of Section 4, the hypotheses of Ledoux's inequalities from [Le] do hold, these provide 
only one-sided deviation estimates which will not be sufficient for our later purposes. In this 
situation the return to Yurinskii's method appears to be the only way out. 

Define the decreasing sequence of cr-algebras J^k = '^i{^i}i>k- Furthermore, for c, 7 > 
and k e J\f, let 

Ak = A,c,7,iv = ju; G Q : \gN,p [Hji{(T)]\ < c7V-i+t| (5.1) 

where 

- E E f^-x. (5.2) 

We put and A = Ac,'y,N = C\k=i Ak- The set A will be our 'good' set. We first show that its 
measure is large. 

Lemma 5.1: For all j,c,m> 0, there exists C > 0, such that 



nAc,j,N] > 1 - CN- 



(5.3) 
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Proof: Since FlA""] < Ylk=i^[-^k''] we only need to show that for each A;, P[A1 < CA^""", 
for any m. By the definition of the sets Ak, Chebyshev's inequahty and Jensen's inequahty, 
we have, for any I G N, 



M{N) 



> cN^ 



M{N) 

M{N) 

( E 



2Z 



(5.4) 



21' 



If we can show that the expectation on the right-hand side is bounded by some A?^-independent 
constant, (5.4) will prove the lemma. 

Expanding the power in the integrand yields, with the usual multi-index notation. 



Eg 



M{N) 
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r-M{N) 

r:\r\=2l M=l 



(5.5) 



where r is a multi-index and the numbers C2i^r the multinomial coefficients. The main 
point in what follows is the realisation that the difficult terms are those which have at least 
one /X with = 1. This is due to the following observation, which is a simple consequence 
of a result proven in [Ni2] . 



Lemma 5.2: There exist constants c,K>0 such that for all N large enough, 

M{N) 

sup ^{Hi:{a)f<c 



(5.6) 



with probability at least 1 — e 



Proof: We write the left-hand side of (5.6) as 

M{N) I M(N) 

E (H^M)" = 1^ E E -T^Teja 



1^=1 



H=l T,j3k 
rN-l\ 



api 



T E '^lE 



T,j3k 



aNP- 



(5.7) 



Consider cr as a vector in an {pZ^) dimensional space, and (y-~^N^~^Ylfj,^i^j ^ the coeffi- 
cients of a matrix P representing a map from this space onto itself. Then, denoting by Xmax 
the operator norm of P, uniformly in a, 



M{N) 

E 



apl 



ap\ fN-1 



Ni-P \p-l 



Xmax < apX 



(5.8) 



Fluctuations 



29 



In [Ni2, Theorem 2] it is shown that Xmax is bounded by a constant with probability at least 



-KN' 



with Z G (0, 1). This proves the lemma. □ 



Returning to (5.5), wc will try to get only terms of the form bounded by the lemma above, 
the idea being that we do not really want to integrate, but rather use a uniform bound for 
the integrands. We therefore single out those /x's for which = 1. We obtain 



Eg 



( E ^0 = E E '-i^rEg 



|J-|<2! |r|=2! 



n^r n 

ij-ej iJ.eM\j 



k ) 



(5.9) 



where the compatibility relation r<ij means that for all G J", = 1. Since the ji ^ M.\J 
will not enter in any of the calculations that follow, we write (the relation r < J now denotes 
the condition that V^u ^ J, r^j, = 0) 



Eg 



( E ^.') = E E 



J<ZM: 
\J\<21 



^2l-\J\ 



n^r n 



\J\<11 



E n^fc" E ^^^^'^m n (^r)'-^ 



(5.10) 



At this point, we expand recursively the Boltzmann weights with respect to the terms iifj^, 
[i^ J . This will generate new terms which are slightly more complicated than the term we 
started with. The procedure stops when no is left to expand in. In particular, since \ J\ 
does not depend on N ^ this will ensure that none of the appearing factors will depend on 

We use the following notation. We order the set J in the canonical way, i.e. J = 
{//I,... with i < j ^ fj,i < fj,j. Then, we define interpolating Hamiltonians (they 

will reappear later) 



(5.11) 



In particular, H = f{^^'■■■^^^" ^ ^j^d if Uj = 0, then -ff^^ 'u^ independent of The 
associated Gibbs measures and partition functions will be denoted by gul','.'.'. ',un ^ respectively 



«1 ,U„ 



-'^-'^One may ask why we do not expand jointly in all the patterns /i € J7 at once. It turns out that one needs 
a similar recursive scheme since there will always be error terms which cannot be treated by Lemma 5.2. 
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The terms that wih appear are of the form 



i=n' + l 



i=l 



(5.12) 



where q < n', and the tTj, j = 1, . . . ,n are functions from {1, . . . , n'} to {1, . . . , n'}. They 
appear because the expansion of the denominator (the partition function) wih introduce new 
copies of the measure (hence the power q). 

The first product in the integrand above contains the with respect to which the ex- 
pansion has not yet been done. The second corresponds to those which have been used. 

The initial expressions on the right of (5.10) correspond to the case g = 1, n' = 0, itj = 1, Vi, 
that is, 



8=1 



(5.13) 



The following provides the basic recursion relation. 

Lemma 5.3: For all numbers n' G {0, . . . , n — 1}, g G N, and ui, . . . , and functions 
TTn' , there exist functions (7r^/_|_i)j=i,... and a number Un'+i € [0,1] such that 



^ i'ui,... ,u„, 



n ^/r(ai)n^r(^')^rK"'^*^K:^(^': 



i=n' + l 



i=l 



n'+l 



n n i?r(cT^)^r(cT<'+^«)/:^(a^) 



i=n'+2 



1=1 



n' + l 



n ^r(^') n i^r(^')^r(^'^"'-^^^K:r(ai) 



1=1 



(5.14) 



The functions (7r^/_|_i)j=i,... ,q+i satisfy 



K'+iii) 



TTn'ii), if i < n'; 
j, if z = n' + 1. 



(5.15) 



Proof: Wc expand the Boltzmann weight of the Gibbs measure on the left-hand side of 
(5.14) in the pattern Hn'+i- Since -ff«i;;.V;«",' = i?C,V.V,«",',«",';;^i U^,^,=i, expanding in the 
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variable about to zero order with remainder of order 1 yields 

exp (-/3Ei'=i<\v::,t";(a^')) exp (-/3Ei'=i<r:r:;:o"'"H^o) 



\^ui,...,u„, ) l^Mi,...,n„,,0 , 



9 



+ 



. exp(-/3E?'.i<::::::::X:V:^(a^')^ 

/O \ ^ V /_ Tjf^n' + l 

/3 exp ( - /3 E,^'=i <::::,t::,t"':; (^^■')) 

(5.16) 

for some Un>+i € [0, 1]. 

The first term on the right does not depend on CC"'^^ (see the remark after (5.11)). Hence, 
when multiplied by the products of the Hj^, this disorder variable appears exactly once, so 
that integration with respect to it yields zero. 

The second and third term above give the new terms on the right in (5.14). The relations 
for the functions 7r^/_|_i are easily verified. □ 

Applying this recursion relation n times yields the following decomposition. 

Lemma 5.4: Let J = {/xi, . . . , fj,^}, n < 21. Then there exist numbers ui, ... , u„ G [0, 1] 
such that 

i=i 9=1 TT^q 1=1 

(5.17) 

where the functions vr permute the indices i G {1, . . . ,n}, and the relation tt ~ g describes 
the condition that \{i G {1, . . . , ra} : 7r(i) 7^ 1}| = q. The number of such functions n is thus 
independent of N. 

Proof: The proof follows by applying the recursion relation from Lemma 5.3 n times. Ob- 
serving that each step adds at most one other replica implies that q < n. D 

We finally sum over the sets J C M on the right of (5.10). We obtain 

J'CM: 0=1 -K^q i = l 

\J\=2l ^ 
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First, we observe that since li^j^l < 1, 

\cj\< ^^i^r,\ji n i^ki"^"^ E ^^i,r,\j\ n (5-19) 

t^eM\j ,„:_:!;;'-T., neM\j 



\r\=2l-\J\ 



where Sa^b = 1, if a > 6 and zero otherwise. 

For any multi-index r, denote by #r the number of which are not zero. Hence, the 
products on the right-hand side of the above inequahty are just the completely off-diagonal 



terms of the form I ^ 



. Then, adding the terms which have at least two 



indices equal (and which are obviously positive), yields uniformly in a 



2l-\J\ 



2l-\J\ 



\^j\< E E iHj:fy< E s-wi(E(^n')'<c> (5-20) 

on a set B of measure at least 1 — e~^^ ' by Lemma 5.2. Using this in (5.18), we bound 

/' = EiB^[(E^ifOTby 



JCM. o=l irr^q 
\J\<21 



i=l 



(5.21) 



Since the integrand is non-negative and < 1, we can change the Boltzmann weights 

back to the original ones (that is, setting all = 1), and committing at most an error of e'^". 
Furthermore, the functions tt depend only on the size of J. Hence, adding again positive 
terms in the third step below (and observing that \J\\s even), 

21 n n 

\n<cY. E EE^--«./3^i^^®''[n|^r(^')^rK^^^) 



n = JCZM: TT^q q=l 

even \J\=n 
21 



^^EE E E«-../3Ei^^^'[n|^r(^')^rK^^^) 

Tl = TT^Q J<ZM.: (7=1 i=\ 

even \J\=n 
21 ^ M n n 

^ ^ E E E E^^^.^f^^^BG^m |^r(^')^rK^^ 

n=0 Tr^q ' ui,... ,u„ = l g=l i=l 
even r- > n- 

21 ^ n n M 

^ ^ E E ;^E^-.-/^^i^^^^[n ( E m'i<r')H','{cr^^n) 



(5.22) 



n=0 7r~g g=l 
even 



1=1 /ii = l 

Finally, we apply Cauchy-Schwarz to get rid of the absolute value in the sum over /Xj, 

M M I M 1 

Ei^r('^')^rK^^^)i < ( E(^r(^'))')'( E(^r('^'^^'^))')' < c (5.23) 
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on B by Lemma 5.2. Inserting the above in (5.22) shows that Elg^f^^i?^] is bounded by 
a number independent of N, since all the remaining sums are over finite sets whose sizes do 
not depend on N. 

Since (^^ H^y^ is polynomially bounded in N, uniformly in u, the remaining part I — I', 
(that is, the integral on the set B'^), is obviously bounded by an exponentially small number 
in N^/^ (e.g.), and is thus also smaller than a constant. 

We use this in (5.4) which shows that 

< qc-2'iV-2T'. (5.24) 

Thus for all 7,m > 0, there exist I and Ci^m such that 

F[A1 < Ci^mN-'^-K (5.25) 

Summing over all fc = 1, . . . ,N shows that indeed P[^'=] < Q^rnN'"". □ 
We now bound the fluctuations of the free energy on the set A. 

Proposition 5.5: Let Fn = In ZnI^^ ^^. Then, for all (3, all t > Q and all e > j, 

there exists N < oo such that for all N > N, 

Fjv - EFatI > t(3N-^+^] < 3e-^'^\ (5.26) 



Proof: In the sequel, A^, (3, 7, c will be fixed, and we will therefore frequently drop the 
corresponding indices. The approach to the proof follows the general idea of [BGP2,B1]. 
Define a decreasing sequence of a-algebras {^k}ken by 

^fc=^(ur}r>r) vA,,,iv. (5.27) 

This allows to introduce a martingale difference sequence (see [Yu]) 

F'' = E[F\:Fk]-E[F\Tk+i]. (5.28) 



By the definition of conditional expectations 



N 

F-EF = ^F'=P[^]. 
fe=l 



(5.29) 
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The factor P[^] tends to one as A/" | oo by Lemma 5.1 (even polynomially as fast as we want). 
It is therefore enough to control the sum Ylk=i observe that 

N ^ 

P[|y F'^l > z(P[^])-'] < 2inf e-*^(^[-^l)"'Ee*5:.=i^'= 

^1 *>° (5.30) 

= 2 inf e-*"E [E [. . . E [E [e*^' |J^2]e*^' • ■ ■ ]e*^'' \Pn+i]- 

To make use of this inequahty, we need bounds on the conditional Laplace transforms, that 
is, we want to show that for some C^{t), 

\n¥.[e'^"\h+i]<C\t), (5.31) 

uniformly in Tk+i- Using a standard second order bound for the exponential function, we 
get 

E[e*^Vfc+i] < l + |E[(F'=)2el*^'l|.Ffc+i]. (5.32) 

To make use of this wc need to bound \F^\- A conventional strategy is to introduce a family 
of Hamiltonians (a, u) , defined by 

H\a,u)=H{a) + {l-u)^^^ ^ ^ ^^a^. (5.33) 

u=l IBk 

This new Hamiltonian is equal to the original one for n = 1, and independent of {^^ }''^^' " 
for u = 0. Denote by Z'^{u) and Q'^{u) the partition function, respectively the Gibbs measure 
associated to this Hamiltonian. Observe that the condition on being on the set A is stable 
against the change in parameter n G [0, 1], that is 

M{N) 

g''{u)[N-P E^x^x] ^ [-^'^]' [0,1], (5.34) 

1-1=1 I3k 

on the set A. Indeed, the derivative of the left-hand side with respect to u is non-negative, 
since it is the variance of the integrand with respect to the measure Q{u). Moreover, for 

= 0, the Boltzmann weight does not contain aj-, whence the left is zero for u = 0. The 
absolute value of the left-hand side thus assumes its maximal value for = 1. 

Define 

g\u) = ^lj,\nZ\u) - ll^lnZ^(O). (5.35) 
Since Z^{G) is independent of Ufc, this quantity relates to via 

F^=¥. [g\l)\h] - E [/(l)|/-it+i] (5.36) 
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Observe that g'^{u) is convex in u, since its derivative is equal to the expectation of the left- 
hand side of (5.34), whose derivative is the variance of a random variable with respect to the 
measure^. Since by its definition (0) = 0, and therefore |cj'''(l)| < max(|(cj''')'(l)|, \{g''y{0)\), 
where the prime denotes the derivative with respect to u. Moreover, since H^{a, n = 0) does 
not depend on cjfc, it follows that {g^)' {Q) = 0, and hence we can use < 
Explicitly, this is 



1/(1)1 < |(/)'(1)| 



NP 



I M{N) 



J 



< cN' 



-1+7 



(5.37) 



Inserting this bound into the exponent on the right-hand side of (5.32) gives 
1 + ^E[(F')'el'^*l|;f-t+i] < 1 + lEKF'j^el'f'WIlA+i] 



(5.38) 



To treat the quadratic term, we observe that by (5.36), the properties of conditional expec- 
tations, and Jensen's inequality (see also [B] and [BGP]), 



E[(F'=)2|J^fc+i]=E 



= E 
< E 
= E 



(E [/(!)!;£•,] -E[/(l)|j£-,+i])2 

{ng\i)-n9\im+i]\h]f 

E[(/(l)-E[/(l)|.Ffc+i])2|.Ffc] 



J^k+1 
^k+1 



(5.39) 



(5^(1) -E [5^1)1^+1])' 
The last term is bounded since we are in the set Ak- Indeed, 

2 



E 



(/(l))'1-^fc+i 



M(N) 



I3k 



Tk- 



< P^CN^^-^, (5.40) 



Thus, using the bound (5.40) in (5.38), 



(5.41 
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Inserting this in (5.30) yields 

PO^F'^I > ziF[A])-^] < 2inf exp ( + ^e^'^^*^ '^""C/J^AT^^-M . (5.42) 
fc=i ^ 

We choose z = Tf3N-^/'^+^, and t = jN^ = . This implies that 

N 

Pd^F'^l > /3riV-H-(p[^])-i] < 2exp (-Ni + Cr-^N^'^-'e^^^'"'''"'"^'"'") . (5.43) 
fc=i 

Choose 7 < e/2. Then for any r > 0, and large enough, the right hand side of (5.43) is 
bounded by 3e~-^'^^. Since P[^] tends to 1 as 1 — N~'^, the claimed estimate follows. □ 

Proof of Theorem 4: The assertion is now an immediate consequence of Lemma 5.1 and 
Proposition 5.5. Indeed, 

\Fn-EFn\ < \Fn-Fn\ + |Fjv -E-Fjvl + |EFjv -EFjv|. (5.44) 

The first term is non zero only on A^. Also, the last summand is bounded by P[.4'^] sup Fjy < 
CNPFlA''^]. If wc choose m in Lemma 5.1 larger than p + n + 1, then this term is eventually 
less than N~'^, and thus also less than z = tN~^/'^^^. Thus, for all n, r, e > 0, and A'' large 
enough, 

¥[\Fn -F.Fn\> z]<¥[\Fn - Fn\ > ^]+¥[\Fm-KFn\ > |] 

< CA^PP[^^] + ¥[\Fn - EFjvI > J] (5-45) 

This concludes the proof of the theorem. □ 
6. Results on the Replica Overlap. 

In this section, we prove the results on the replica overlap, Theorems 1.5, 1.9, and 1.7. 
6.1. Proof of Theorem 1.5. 



By the definition of the free energy, 

M{N) 

dp N 



= -I^OnAH] =-f3j2 ^ONAH'i^)i (6-1) 
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where 



cr 



NP 



(6.2) 



XCJV 
|T|=p 



is the contribution to the Hamiltonian from pattern ii. We introduce the following notation. 
For any u G [0, 1], we let be an interpolating Hamiltonian of the form 



(6.3) 



Observe that for = 0, this quantity is independent of the pattern fx, and for n = 1, is equal 
to the original Hamiltonian. The notations and Z!^ refer to the corresponding Gibbs 
measures and partition functions (dropping reference to N and (3 for sake of clarity). We 
now write the Gibbs ectation on the right of (6.1) as 



-f3Ht: 



(6.4) 



u=l 



Developping the Boltzmann weights in u about with second order remainder, we obtain for 
each term in the sum on the right-hand side of (6.1) (for some u G [0, 1]) 



-/3i?o^(T) 



^0 



IT 



Ri 



3/32 



-^fi^(a)-/3i?^(<T') 



13^ 



«2 

-(3H^{a)-l3Hi:{a')-l3Hi:{a") 



-H''{a)H''{a')H^'{a") 



R3 



(6.5) 



As remarked above, neither Hq nor Zq contain any of the variables {^f jieA/"- Integration 
with respect to them (denoted by E^) thus yields for the linear term. 



EE, 



NP 



ICJV 
\X\=p 



mi — E^x^xf^x 



0, (6.6) 



38 



Chapter 6 



and for the second order contribution 



EE, 



^0 



P 



]\[2p-2 



_/V2p-2 



E'En 



E'E^ 



z, 







I,J 



-phi; (a) ■ 



(6.7) 



- Ar2-2p(i + c'(iv-i)), 



respectively, 

\-l3H^{a)-l3HS(a' 



EE^„, 



EE„ 



^-0H^{a)-l3H^{a') 



(6.8) 



The latter sum is 



iv p 1 / ^ 

TCAT ^' n,-.,ip = i i=l ^' \i=l / 



all different 



(6.9) 



whence, 



EE 



= -NPR{a,a'Y{l + 0{N-'')), 



(6.10) 

We now show that the remainder terms in (6.5) arc at least one order (in N) less than the two 
leading contributions above. We start with a result that shows that the perturbed partition 
function = 'Kfy\e~^^^] is bounded from below by a constant times the partition function 
Z = Zq (that is, the one not containing any of the {^fji). 

Lemma 6.1: For all P >Q there exists a constant c > such that for all u G [0, 1], 

Z^>cZ^ = cE^[e-'3^o]. (6.11) 



Proof: The proof is an immediate consequence of the following result. 

Lemma 6.2: Let be a familiy of variables taking values —1 and 1. Let 

Tp.iv = J2i-\i\=p-^i> '^^'^ — ^i-^i- Then for each even p there exist constants 
Cp^q such that 

q=Q 
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Moreover, Cp^p is positive for all p. 
Proof: By induction. For p = 2, we have 

N N N N 

i=l i,j=l i=l 13) 

which is of the form claimed in (6.12). 

Suppose the result is true for all even values q < p. Then, 

Tp+2,N=N-P-^ Xj = .p+2X^ +2 

X:\X\=p+2 \ 2 )^"' I:\I\=P J--\J\ = -^ 



= cpN-^-^ E E xj-c,N-^-^ 

T:\T\=p J:\J\=2 MA=P -7^IJI = 2 

By the induction hypothesis, the first term on the right-hand side is 

^ ^ Xj = CpVp,NT2,N 

X:\X\=p J:\J\=2 

= cp (^Cp,2X'^''"^(l + ^(^"')) ) ij2''2Mm'm'i-\l + 0{N-')) 

\q=0 J \q=0 J 

f + 1 

= Y Cp,2,m2«7V9-i-i(l + O(Ar-i)). 

q=0 



(6.14) 



(6.15) 



The remaining term in (6.14) is 

E E ^I'^j = E ^I'^j + E ^T^^j 



Y Y Y^^^^^3+ Y Y^^^^^i 

X:\X\=pi<^M\X I:\I\=pi,j€X 

Y ^^Y Y Y ^^^f 



(6.16) 



X:\X\=p ieN\X X:\X\=p-2 i,jeAf\X 

2 



(iv-p)ivfrp,jv+ (^^ nNP-^rp_2,N, 



and hence 



Y ^>7 = ^"%iv(l + 0(iV-^)) + Ar-%_2,jv(l + 0(A^-')). (6.17) 



X:\X\=p J.\J\='i 
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Applying the induction hypothesis to (6.17) shows the decomposition (6.12). Positivity of 
Cp^p follows from (6.14). □ 



From this one concludes that uniformly in a, ^, and for all N large enough, 



-H^" > -c. (6.18) 



Indeed, by the preceding result (setting Xi = CTj), 



I:\I\=p 
f / AT 

= (p!)V2iv^ N'^-Hl + O J2 (^"')) (6.19) 

q=0 \ i=l J T:\T\=p 

E 

2 

= iV ^ Cp,2q{m^'fm^-^{1 + 0{N-^)). 

q=0 

We distinguish two cases. If m'^ is large, we show that —H^[a) is positive. Suppose therefore 
that |m^((j)| > Ar-V2+<5 foj. ggmg 5 > o. Then, 

p/2-1 

£-1 

2-1 
q=0 



which is obviously positive for all N large enough and 6 less than |. 
On the other hand, if is less than A/"~^/^+'^, then. 



p p 
2 2 

|7V-ii7'^(a)| < ^c;_gAr2«('^-*)iV«-5 = ^ c^^^iV-S+f'^. (6.21) 

9=0 q=0 



Thus, if (5 < I — i, then = o(l), so that the bound (6.18) is in fact a gross underestimate. 
To prove Lemma 6.1, we observe that 



This proves the (6.11). □ 
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We apply this result to the error terms in the development (6.5). We start with Ri. By 
Jensen's inequality, 



^11. 



(6.23) 



Since the integrand is a positive function, we may bound the expectation using Lemma 6.2 
in the denominator. We obtain, noting that H!^ = Hq + uHi^, 



\Ri\ < cE„ 



^0 



(6.24) 



We observe that the last Gibbs measure does not depend on the pattern /x. We may therefore 
integrate with respect to {Cf }i "inside" . In complete analogy with Chapter 3 (the result about 
the error term), we get 



3p 



whenever (3u < (3'^. Since u G [0, 1], this condition is satisfied if /? < 

The remainder gets essentially the same treatment. By Jensen's inequality. 



(6.25) 



(6.26) 



Hence, 

EI-R3I < cN^'"^. 
Finally, the term R2. By Lemma 6.1, 

= mH'^^jgi^iH^^w < giiiH^^^jg^iiH'^i] 

< cg^[e-'^''"''H'''']g^[e-f^''""\H''\]. 
Thus, by Cauchy-Schwarz and Jensen, 



(6.27) 



E\R2\ < 



E 



< (E 



H^'^]f'jY (e [(g^Ie-^^-f^'/f'^D^])* (6.28) 

Both factors are now treated as Ri . Since the integrability of Ri did not depend on the power 
of H'^, but merely on the exponential factor (this is apparent from the estimate (3.26)), we 
get that whenever 2(3u < l3p, 



E\R2\< {cN^-^P)^{cN 



(6.29) 



42 



Chapter 6 



The above condition is always satisfied if /? < |/3p. 

Tlie results above almost prove the theorem. What remains to show is that in the leading 
terms, we can replace without harm the Gibbs measure Qq hy Q. More precisely, we claim 
that 

\Eg^^^[RP]-Eg^^[RP] \ < cA^i-f , (6.30) 

for some constant c. 

The proof of this claim is done exactly as before, namely by expanding the Boltzmann 
factors, this time, however, only to zero order. We get 

g^^lRP] = g^'^^[RP]+g^^®^[R{a,a'y{H^'{a)+H>'{a'))]+g^^''[R{a,a'rH'\a'')]. (6.31)) 

Since Rp £ [0, 1], the second term on the right is bounded by 

\gi:^^[Ria,a')PiH''{a) + H>^ia'm = 2|ar'[^(^, < '^Gil[\Hia)\]. (6.32) 

Proceding as above we get, 

\EgP;^^[R{a,a')P{H^{a) + H>'{a'))]\ < 2EgP;[\H{a)W < 2cE, g^fe"^"-^" liJ'^l] < 2c'N^-^. 

(6.33) 

The third term on the right of (6.31) is bounded by the same order. Indeed, 

\g^:^'[R{a,a')PH'^{a")]\ < g^[\H'^{a)\], (6.34) 

from which the bound follows again by integration. This proves the claim (6.30). 

To finish the proof of the Theorem, we sum the contributions we have obtained. Relation 
(6.1) implies that 

M{N) M{N) 

-^Eg[H]- i3N^-p+ pN^-pg^^[Rp]) 



f3E ^ - a/32(l -Eg®^[RP]) 



M{N) 



^=1 
M(N) 



]-Eg[H] - Y PN^'^ + Y f3N^~^Eg^^^[RP 



N 



M{N) 



+ ^ N^-P\{Eg®^[RP]-Eg^®'^[RP\)\ 

(6.35) 

Using the decomposition (6.5), and the results (6.6), (6.7) and (6.10) in the first term, and 
the bound (6.31) in the second, we get 



8F 

I5E^ - a^^{l - Eg®^[RP]) 
op 



M(N) 
M(N) 



(6.36) 
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We finally insert the bounds (6.25), (6.26) and (6.29) on the errors Ri, which are valid if 
P <^l3'p. This yields 

dF 



< cpN-^ + c'^N^-^ < Cp. (6.37) 



op 

This proves Theorem 1.5. □ 

6.2. Condensation: Proof of Theorem 1.6. 

Theorem 1.6 follows now just as the analogous result in [T3] from the convexity of the free 
energy. Suppose that (3 < fip. Since we always assume that a > Op, then 

limsupEFjv = ^ (6.38) 

by the definition of Pp. As remarked after their definition in Chapter 2, EFjv is convex for 
all N. It then follows from a standard result in convex analysis ([Ro], Theorem 25.7) that 

limsupE— — = — limsupEFjv = a/3. (6.39) 

ATToo Op op ATToo 



Hence, from Theorem 1.5, 



Eg'^^[RP]+E—^ = a(3 + 0(N-^), (6.40) 
op 



and thus, passing to the limit. 



lim sup E g®^ [RP] +aP = a/3, (6.41) 

JVToo 



which in turn implies that 



limsupEg®2[i?f] =0. (6.42) 

Suppose now that 

f)F 

lim sup E — ^ < ap. (6.43) 

ATToo op 

Then it follows immediately from Theorem 1.5 that 

lim inf E ^^P] = a/3 - lim sup E > a/3 - a/3 = 0. (6.44) 

ATTcx) jV|oo op 

This proves (1.27). To see where the condition (6.43) actually holds, we observe first that by 
Lemma 4.5, it is satisfied for all 



^/3;/3>/3p = y^. (6.45) 
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This concludes the proof of the Theorem. □ 

Remark: Of course one would expect (6.43) starts to hold right after the critical temper- 
ature. In fact, a weak version of this can be proven. Namely, Theorem 5.5 in [Ro] implies 
that the function 

/(/?) = limsupE Fiv (6.46) 

Nfoo 

is a convex, bounded function onU = [0, /?p). By Theorem 25.3 in [Ro] it is thus differentiable 
on an open set P C W which contains all but perhaps countably many points of U, and its 
derivative /' is bounded on V. Lebesgue's integrability criterion then implies that 

/? 

/(/3) = fiPp) + J f'{u)du, V/3 > (3p. (6.47) 

Now it is immediate that for all (3 > Pp there must exist a set I C (/?p, /3) with strictly positive 
Lebesgue measure, on which /' is strictly less than a/S. Indeed, were this not the case, then 
/ > , which contradicts the definition of (3p . Since /9 was arbitrary, the relevant condition 
(6.43) is satisfied on sets of positive Lebesgue measure arbitrarily close to Pp. 

6.3 Proof of Theorem 1.7. 

We have shown that in the low temperature phase, the replica overlap is not concentrated on 
zero. We will now show that its distribution is concentrated on a neighborhood of zero and 
1. 



Proof of Theorem 1.7: Let CJi^Cj^ be such that 



sup(-iJ^(a))^[ArCj^,iVC+] 



VN = o{l) (6.48) 



Then 



W%\RN{a,a') el)< EI,,p^|^^(,)|<^c.^^^ o N2C- 

EE.,.,e-/3(^-W+^^-(-'))i_^^^ 
= ^Pn 

(6.49) 

The numerator has been estimated in (4.21). Using this, we get 



exp ( N 

^gf{RN{a,a')eI)<J2Cs 



2PC^ - 2a/3(l+tP)) ~ -^(*) 



+ Pn 



= g C3 exp (iV2/3(C+ - C^) + iV (2 In 2 - -^^^ - m)) + Pn 
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Let us note first that from (6.50) it is obvious that if we can choose — Cj^| < iV~^, 
then the result cannot depend on (3. An obvious candidate for these numbers is thus 
iV~^Esup^(— ii"Ar(o")) =b e. Indeed we have 



Lemma 6.3: For any e > 0, and for all N large enough, 



-^sup(-iJjv((T)) -E-isup(-i7Ar((7))| > e 



< N- 



(6.51) 



Proof: Note first that 



and therefore 



Therefore, for any f3 < oo, 



2-^ < Zjv(/3)e^""P<'(-^^('^» < 1 



\^FN{f3) -^sM-HN{a))\ < ^ 



(6.52) 
(6.53) 



^ sM-HN{a)) - e1 sup{-Hn{c7)) 



< 



1 



1 



^f^{P)-e-Fn{P) 



(3 ' (3 
21n2 



N 



P 



P 



+ 



By Proposition 6.2, 



^Fr,{l3)-E^Fj,{P) 



< CAT-" 



(6.54) 
(6.55) 



Using this result, and setting Cn = E-^ sup^{—HN{a)), we get that 



from which the claimed result follows by choosing e.g. (3 = e 41n2. □ 

03 tJ-X-p I iv -r iv 1 z m z — 

tel 



Eg%^{RN{(J,a') G /) < ^Caexp ( Ar4/3e + A^(^21n2 - 



a{l+tP) 



m) 



(6.56) 



Since e can be chosen as small as we like, e.g. we already see that our result will be 

uniform in (3. 

It remains to estimate E-^ supg.(— i?Ar((T)). We will only consider the case a > In 
that case it follows from Lemma 3.4 that Cat < \/2q! In 2 + C/N from a bound completely 
analogous to (2.3). For a lower bound, note that for any /?, 



^1 1 

E^Fjv(/3) = -Eg^^-HNia)) < E- sup(-iJjv(c7) 



(6.57) 



46 



Chapter 6 



But we know that for all /? < limjvfoo ^Fn{P) = 2~' therefore by standard results 
limjvtoo = a(5. Thus chosing (3 as large as possible we see that we see that 

Cn > a/?p - (6.58) 

where (^jv | 0, as iV | oo. But Theorem 1.2 and the estimate (1.20) show that 



Cn > V2aln2 - ^ ^ - 5n 

V21n2 

Therefore we have that for any (5 > 0, and for p large, 



(6.59) 



21n2 



iv(21n2-^-/(i)))+Piv (6.60) 



< ^ Cs exp lN{5 + 2-n + iV - /(i)) ) + Pn 

tei ^ ^ 



The function — /(t) vanishes at zero and at one, and is negative everywhere in the 

interval (0, 1 — Zp), where ^ 2~p. This implies the main conclusion of Theorem 1.7, (6.48). 
Note that since I{t) ~ for small t, we can chose the interval / more precisely of the form 
Ip = (C2-f/^ 1 - C2P), with C a constant of order 1. 

To proof the estimate (1.29) in the high-temperature case is considerably simpler. Since 
we already have the estimate ET(c, b, 1) < e"^ N-dN/2 some positive d, it remains to 
show that with sufficently large probability, Zjf{P) > e"^ N-dN/i_ ^j^g 
Paley-Zygmund inequality (4.31): 

Zn > c-'^^/^EZn] > P [^at > e-'^^/^EZjvl > (1 - e-'^^/^)C3 (6.61) 

Given that by Lemma 4.1 and Theorem 1.1 EZjv > Ce'^"^^/^, (1.29) follows immediately. 
This completes the proof of Theorem 1.7. □ 

6.4. Ghirlanda-Guerra identities and lump masses. 

The techniques used to prove Theorem 1.5 can also be used to derive the Ghirlanda-Guerra 
identities [GG] (sec also [AC]) that provide relations between distributions of overlaps of a 
larger number of replicas. This observation is due to Talagrand [T5]. Note that he annop- 
unccd more far-reaching results than those we will prove here. 

The basic input is the following slight generalization of Theorem 1.5. 
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Proposition 6.4: Assume that (3 < 2(^'p- f denote any bounded function of n spins. 
Then, for any k E {1, . . . , n}, 



Eg%{N-^Hr,{a'^)f{a\...,a")) 

/ n > 



1=1 



(6.62) 



Proof: The proof of this proposition is an exact rerun of the inequaUties (6.36), except for 
the computation of the leading terms which is however straightforward. We wih not repeat 
the details. □ 

As in [GG] it then follows from the concentration result Theorem 1.4 and standard argu- 
ments that for any bounded function /, 

hm f dl3mt'^{N-^HN{a^)f{a\...,a^))-WN,p{N-'HN{a))Wf'p{f{a\...,a^)) =0 

(6.63) 

for any f3' < f3" . Combining (6.62) and (6.63) with the bounds (6.62), we arrive at the 
identity 



ATTcx) 



hm / d/3Eg®yi 



f{a\ . . . ,a") I ^i^^(a^c7') - ni^^(a^ a"+i) + E^^f^ {RU^\a^)) 

l^k 



(6.64) 



which is the analogue of (16) of [GG]. Note that this can be written as 

b" 

hm / dm%7'[f{<y\...,<ynK{a\a^+^)] 

Nloo Jg, '- 



1 



b" 



= 3 Jim / dpEg^'^g 



f{a\. . . , a-^) I E i^^(a^ a') + E^^^^ (i?^(a\ a^)) 



n Nioo J p. 

and choosing / to be the indicator function 
This implies that 

h" 

hm d/3Eg®yi [R^^{a\a^+^)\ik^iRN{a\ai) = qui] 

l^k P 



(6.65) 



(6.66) 



(6.67) 
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which is the relation (17) of [GG]. 

Remark: While [GG] claim to obtain the same relations also for all other moments of the 
replica overlaps, it needs to be said that they tacitly assume the continuity of the Gibbs 
measures with respect to certain random perturbations of the Hamiltonian that is not only 
not proven but is certain to be false in the generality they are announced. Otherwise, the 
argument below could be considerably sharpened and simplified. 

The main use of the identities (6.67) is that they allow to draw conclusions about the 
distribution of the masses of the Gibbs measures on the so-called ' 'Talagrand-lumps'. 
Proof of Theorem 1.8: The starting point of the argument is that Theorem 1.5 together 
with Theorem 1.9 in fact imply that the distribution of the replica overlaps has positive mass 
both near zero and near one. Let us set 

Po^Egf{\R^{.,.)\<eo) ^ ^ 

(6.68) 

Pi=Egf{\RNi;-)\>l-ei) 

Since by convexity (see (6.39)) for all /? > Pp, except possibly for a countable number of 
exceptional points 

aPp < liminf E— Fiv(/3) < liminf E— Fiv(/3) < Va2 In 2 (6.69) 
we have on the one hand that 



and 



V a 2 In 2 

hmsuppo < —57; r (6.70) 

N a(J{l - eo) 

limsuppi < (6.71) 

Since we know that limi^{pQ +pi) = 1, and this implies what we want for f3 somewhat larger 
than /3p. RecaU that eo ~ and ei ~ 2"^. 

This result shows first of all that it is not possible that the mass of one single (pair of) 
lump(s) can be almost equal to one, since in that case po would be close to zero (which is 
impossible by (6.71)). 

Now assume that the assertion of Theorem 1.8 fails. Then there exists a first instance k* 
such that 

lim EGn (^tliCi) = 1 (6.72) 

(n) 

Now define events Qeo € Bn by 

Qin) = 1^ e l]"("-i)/2|Vi<Kfc<n|i2;fc| < Co} (6.73) 
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The important obervation is that if {-Rjv(ci, (Tfe)}i<J<fe<fe* € Q.i'^ \ then there exists some 
permutation tt G Sk* such that with probabihty one G C7r(fc) for all k < k*. In particular 



hm / dpEgf" +1 



'N,l3 



= lim / dpEg 
iVToo 7^, 



But 



(6.74) 



(!) 



(!) 



TreSfc. J = l 

= E EE^^'/'[^'Ar(^',^^')I...,.eC.(,,Ivf:,.'eC, 



(0 



T(i) 



(6.75) 

where we used the symmetry betwen replicas in the terms j ^ k to exchange u^*"^^ with 
Note that for the first term we have the obvious (though not very good) bound 



fc* 



0< ^Eg^f;+l[i^^(a^a^■)I.,.^,ec„(,)]Iv-.'6C. 



'"(0 



(6.76) 



= 4m 

while the second satisfies 



',r(i) 



>(l-6)- ^ Eg^r'[l<^-+.^c.(.)%.<^'ec.,, 



(6.77) 



where we used the obvious permutation symmetry among the first k* replicas. Let us now 
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/ If* \ 

use (6.65) with / the indicator function of the event Qe^ . clearly we get 



nb' 



< 



^ lim [ d(mg 

k* Ntoojf^, 



+1 f^f^ 

b" 



*+l 



1 



{RN{crKajn)}l<l<<k* GQeq 



(6.78) 



Comparing (6.76), (6.77) to (6.78) we see that 



(1 - ei)^ < (A;* - l)eg + lim Egf.RPia,a') < {k* - 1 +po)e^ +Pi 



This implies the lower bound 



k* > 



il-ci)"-pi 



Quantitatively, this estimate can be refined to 

k* > C-^23p/2((i - C2-P)P-pi) = 2Ppo{l - 0(2-2p) 
This proves the theorem. □ 



(6.79) 



(6.80) 



(6.81) 



8. Spin Glass Phase: Proof of Theorem 1.9 

Having established the existence of an infinity of lumps that carry the Gibbs measure in the 
low temperature phase, one would like to know whether these are in any way related to the 
original patterns. Recall that in the standard Hopfield model at small a the Gibbs measure 
concentrates on small balls around the patterns Of course the reader will expect that 
this will not be the case here. To prove this fact, we first obtain two estimate the value of 
the Hamiltonian in the vicinity of each pattern. 



Lemma 8.1: The Hamiltonian evaluated at the patterns satisfies 



\HN{a = e)\> 



N 



zN 



< Cl 



e 2a 



if z < /3' 



a/3' 



^ e ^p^^ -2^)^ ^ otherwise. 



(8.1) 



Proof: The Hamiltonian at the pattern is given by 

H{(T = i^) = -;^3T X] ^T^T ~ ^ ^ ^^^^ 

(p!)i /A^\ (p!)5 



(8.2) 



NP- 
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which impUes that 



(8.3) 



We estimate the random part in (8.3) by the same method used in the proof of Theo- 
rem 1.1. By Chebyshev's exponential inequahty, conditional independence of X^^i 
and Y^=\ C^'^f (^^^ ^ ^ A*)' ^^"^ expansion of the exponential, we get for z > 



(j>\ 



NP- 



> zN 



< inf e 



-tzN 



- t>o 11 I 2Ar2p-2 I p 



H — — E 



(8.4) 



The error term can be written as 



1 



jV3p-3 



E 



3 ^ (£1)2 



e J^p- 



Ex €5 1 



-E 



s 1 



e JV2 



(8.5) 



This latter term is exactly the same as in (3.2) (with /? replaced by t). Hence, we get (compare 
(3.3)) 



Minimizing the exponent yields 



< inf e-t^N+^+c,^ 



(8.6) 



(p!) 2 



< 



_ AT 



if < z < aP' 



e ^p^^ 2^")-'^^ otherwise. 



This proves the claim. □ 



(8.7) 



The next result shows that the Hamiltonian does not fluctuate much around a pattern. This 
result was already proven by Newman [Nl] for the Hamiltonian H. In our case this is even 
simpler. Define Bs{(t) to be the {N6)-hall around the configuration a in the Hamming 
distance. Then we have the following 



52 

Lemma 8.2: If S < ^, then there exists a constant C > such that 
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(8.8) 

where 



fsi-)={ (8-9) 
e Pp''"^'' 2(p-iy.)^ otherwise. 

Proof: By standard arguments (see also [Nl], in particular inequality (2.3) and surrounding 
comments) , 



im (8.10) 

< J2 I jnHNiC^) - > {S + z)N], 



3a e Bsi^n : iH^ia) - Hn{^'')\ > {5 + z)N 

m 

where 

We start by calculating the difference |F(C^) - H{^t^)\. Let J = Jg = {1, . . . ,q}. One 
obtains 

^=1 X:|XnJ'|odd 
1^=1 X:|XnJ'|odd 



(8.12) 



~^jjp-i XI ^+^_^p-iXl XI ^T^T 

X:|XnJ'|odd UT^l^ I:\InJ\odd 

Explicitly, this is 

««')-«(n^2Mi g (^_-;)(^)+.Mij^ (8,3, 
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Let US treat the random term in (8.13) first. By the usual procedure, we get 

> zN 
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7VP-1 ^ ^ ^^^^ 

lyj^tJ. I:\ln J\ odd 



< 2inf e"*^^ TT |l + 
~ t>0 -LJ- 1 



I:\ln J\ odd 



3!iV3p-3 



< 2 inf e 
te(o,/3;) 



X:|InJ"|odd 



exp 

p-i 



n 1+ 



2iV2p-2 



r=l odd 



N-q 
p — r 



I:\Ir\J\ odd 



3p 



(8.14) 

The last line follows from the usual bound on the error term (sec the proof of Theorem 1.1 
in Chapter 3; in fact, t can even be chosen somewhat larger than (5p, since the sum over sets 
X contains fewer terms than we had there). 

To treat products of binomial coefficients in last expression, observe that if (? < [^A^^J < ^, 
then the following inequality holds. 



p-i 

p! 

r=l, odd 



N-q\ fq 
p — r J \r 



p-i 

r=l, odd 



P 



{N - qf-'-q'' 



<{N- qf-'q ^ (P) = 2^-\N - qf-'q. 
r=l,odd 



(8.15) 



Using (8.15) in (8.14) yields 



NP- 



-1 ^x^x 

i^T^Hl-.lmJl odd 



> zN 



< 2 inf e 



-tzN 



^^^{^^"-^N-qf-^ + C^. 



(8.16) 



The deterministic term in (8.13) is given by (again using (8.15)) 

— P~l /at \ / \ 1 P~l 



jv"p-i 

r=l, odd 



N — q \ ( q 
p — r 



<^ — T 



p 



(N-qf-^q^ 



< 



2P- 



(8.17) 



-{N-qy-'q. 



(p!)iiVP-i 

If (5 < -, then the last line is bounded by the term for the maximum q. That is 



{pi 



NP- 



1 p— 1 



r=l, odd 



^ (AT - |,5iVj)P-n<5iVj < -NS. 

p - r J \r J - {p\)k NP-^ {p\)^ 



< 



(8.18) 
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Collecting (8.16) and (8.18), we get 

op-l 

F[\H{C)-H{e)\>—TSN + zN] 
(p!)2 



<2 inf e-*^^ 
te(o,/3;) 



(8.19) 



Plugging this into (8.10) gives 



Ppa e 55(e) : l^iv(a) - H^ie)\ H-tttS + z)N] 

[5N\ 



<2y( ) inf e-*^^exp( ^^2P-i(iV-(?)f-i(? + CiV 



(8.20) 

It is straightforward to check that under our assumptions on S and for fixed t, the ratio 
between two consecutive terms in the above sum is larger than 2, and therefore the whole 
sum is at most twice the maximum term, 



\[6N\J t€{o,f3'^) \ 2 J 



Minimizing with respect to t and using Stirling's formula for the binomial factor concludes 
the proof of Lemma 8.2. □ 

Proof of Theorem 1.9: We observe the following elementary fact. By the definition of 
the free energy 

FN{P)<^sup\HN{a)\. (8.22) 
Hence, by Theorem 1.4, for any /3,m,2 > there exists iV G N such that 

P[l sup \HN{a)\ < ^EFN{i3) - z] < P[Fiv(/3) < EFAr(/3) - z] < CN-"', (8.23) 
for all N > N. Suppose that aB„{a) > — Then there exists /3 > such that 

« > — r-^ — (8.24) 
(p!)i(/3,-^) 



which is equivalent to 



^- < \{a(3f3p - ^) < \¥.FM{f5) + CiN-\ (8.25) 
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The second inequahty follows from the convexity of Fn{/3) and the definition of Pp. But then 
we can find (5 G (0, |) and z > such that (for all N sufficiently large) 

^5 + 3z< ^EFn{P) - (8.26) 

and (with the definition of fs from Lemma 8.2) 

fsiz) + din S + {1 - S)\n{l - 6) > 0. (8.27) 
By Lemma 8.1, resp. 8.2, for any m > 0, we can find an iV G N such that for all AT > iV 

M{N) 

¥[3ae U Bs{e):\HN{a)\>N{—r+S + 2z)] 

M{N) 

<P[3aG U Bs{Cn--\HN{cr)-HN{^n\>N{S + z)] ^8.28) 

+ F[snp\HN{e)\>N{-^+z)] 
M (p!)2 

On the other hand, the inequality (8.23) implies that 

P[sup \HN{a)\ < N^^^^^ - zN] < iV"™, (8.29) 
for all N large enough, so that finally, by standard arguments, 

M(N) M{N) 

P[argsup|i7iv((T)|G M Bs{n]<¥[3ae M Bsi^^ ■ \Hn{(t)\ > N{—r + S + 2z)] 

+ P[sup \HN{a)\ < iV^^^f^ - zN] 

a p 

< TV"™, 

(8.30) 

for all N larger than some TV G N. 

To show the existence of an cngp, we observe that the bounds (1.18) and (1.19) on the 
critical /? imply that the quantity al3p{a) ~ -^/a and is thus eventually larger than any fixed 
number. This concludes the proof of Theorem 1.9. □ 
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